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Abstract — In this paper, we introduce two deterministic 
models aimed at capturing the dynamics of congested 
Internet connections. The first model is a continuous-time 
model that combines a system of differential equations with 
a sudden change in one of the state variables. The second 
model is a discrete-time model with a time step that arises 
naturally from the system. Results from these models show 
good agreement with the well-known ns network simulator, 
better than the results of a previous, similar model. This 
is due in large part to the use of the sudden change to 
reflect the impact of lost data packets. We also discuss 
the potential use of this model in network traffic state 
estimation. 

Index Terms — Simulations, Mathematical Modeling 

I. INTRODUCTION 

An Internet connection consists of the exchange of 
data packets between a source and destination through 
intermediate computers, known as routers. The transmis- 
sion of data in the majority of Internet connections is 
controlled by the Transport Control Protocol (TCP) [1], 
[2]. TCP is responsible for initializing and completing 
connections, controlling the rate of flow of data pack- 
ets during a connection, ensuring that lost packets are 
retransmitted, etc. 

Congestion can occur when the rate of flow of the 
connection is limited by some link on the path from 
source to destination. This link is known as the bottle- 
neck link. Routers have buffers in which to store packets 
in case one of their outgoing links reaches full capacity. 
If new packets arrive at a router whose buffer is full, that 
router must drop packets. There exist various strategies, 
known as active queue management (AQM) policies, for 
determining how and when to drop packets prior to the 
buffer filling. One commonly used AQM is Random 
Early Detection (RED) [3]. 

In this paper we model the interaction between TCP 
and RED for a simple network connection experiencing 
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congestion. This scenario, or ones similar to it, have 
been modeled previously for the purposes of evaluating 
RED [4], [5], [6], [7], obtaining throughput expres- 
sions [8], [9], and obviating the need for time-consuming 
simulation [4], [10], [11], [12], among others. There 
are stochastic [9] and deterministic models [4], [5], [6], 
continuous-time [4] and discrete-time models [5], [6]. 

Our models are closest to that of Misra et al. [4]. 
That model successfully captures the average network 
state in a variety of situations. This allows the authors 
to analyze RED from a control theoretic basis. Our aim 
is to develop a model of greater accuracy that will be 
useful in estimation not only of the average network 
state, but of additional quantities. For example, a model 
capable of capturing the mean queue length allows one 
to estimate the mean round-trip time. But a model that 
can capture the range, and better still, the variance of 
the queue length, will allow one to estimate the range 
and variance of the round-trip time. While this level of 
model accuracy can be useful, it is necessary in a model 
that is to be used for our ultimate goal of network traffic 
state estimation. Given some knowledge of the state of 
the network, an accurate model may be combined with 
a filter-based state-estimation scheme (which we discuss 
briefly in Sec. IIVb . in order to estimate the full network 
state at the current time. Network state estimation can 
be useful from the perspectives of both security and 
performance. 

We make several assumptions about the Internet con- 
nection we are modeling. First, we assume it involves 
the transfer of a very large amount of data over an 
extended period of time. In this so-called bulk transfer, 
the senders always have data to transmit for the duration 
of the connection. Common TCP traffic such as FTP 
(File Transfer Protocol) file transfers, and non-streaming 
music and video downloads can all constitute bulk trans- 
fer. Second, we assume that the path from source to 
destination is fixed for the duration of the connection. 
Third, we assume the transfer is one-way, i.e., the data 
packets travel in only one direction. (Acknowledgments 
packets only travel in the other direction.) Fourth, any 
cross-traffic through the path is negligible. Fifth, the 
path contains one bottleneck link whose capacity is less 
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Fig. 1. Network configuration 

than that of all other links in the path. Most of these 
assumptions reflect typical network scenarios with the 
possible exceptions of the cross-traffic and bottleneck 
assumptions. 

Data traveling from the sender to the receiver is likely 
to pass through several intervening routers. However, 
based on our assumption that there is one bottleneck 
link, we need only consider the router whose outgoing 
link is this bottleneck link. All other routers simply 
forward the data along the path, and have unoccupied 
buffers. Combining all of the above assumptions, we can 
model the network we are attempting to represent with 
a network of one sender and one receiver separated by 
one router (see Fig. Q. 

II. THE MODELS 

The primary mechanism used by TCP to regulate 
the flow of data is the congestion window on the 
sender's computer. A window size of W means that 
the number of unacknowledged packets from the sender 
that may be outstanding on the network at any one 
time is at most W. According to TCP, the sender's 
window size follows the additive-increase/multiplicative- 
decrease (AIMD) scheme. Typically, the window size W 
increases additively by 1/W with each successful packet 
transmission and decreases multiplicatively by a factor 
of 2 when packets are dropped. 

Packets needing to be stored in a router's buffer 
due to congestion are placed in a queue. The RED 
module operating at this router keeps track of the queue 
length as well as of an exponentially-weighted average 
of the queue length, which we denote by x. When x 
exceeds a pre-defined minimum threshold, RED will 
cause the router to drop arriving packets with probability 
that increases with x. Note that this adds a stochastic 
element to the connection. We attempt to capture the 
system behavior with a deterministic model; our model 
will not reflect the random component of the dynamics. 
However, as we will show below, the random component 
is reasonably small, and so a purely deterministic model 
can be useful for state estimation. 

Previous attempts to model this scenario determinis- 
tically have made use of either discrete-time maps [5], 



[6] or differential equations [4]. Continuous-time models 
employing delay differential equations may do well in 
capturing the aspects of network behavior that evolve on 
small-time scales, such as flow rate increases. However, 
they are likely to smooth out the effects of sudden 
large changes in state (such as flow rate reductions). 
Furthermore, systems of delay differential equations can 
be cumbersome to express and solve due to the delay. 

We address the above issues through innovations in 
our models, namely, a discrete impulse in the continuous- 
time model, the choice of time-step in the discrete- 
time model, and a packet-based frame of reference used 
by both models. The continuous-time model presented 
in this work combines a system of differential equa- 
tions to capture the evolution of the small-time scale 
changes with a discrete impulse (sudden change in one 
of the state variables) to represent sudden large changes. 
The discrete-time model takes advantage of the fact 
that a congested bottleneck will impose uniform packet 
spacing. Using this spacing as the time step allows 
the discrete-time model to nicely capture the system 
behavior. In addition, as explained below, both models 
utilize a packet-based frame of reference for the state, 
which simplifies handling of the delay in the system, 
making the models easier to express and execute. 

To describe the system, we consider the state variables, 
all of which have units of "packets" but are allowed to 
take non-integer values: 

• W - the congestion window size of the sender; 

• q - the length of the queue at the router; 

• x - the exponentially-weighted average of the queue 
length at the router. 

In our packet-based frame of reference, W(t) represents 
the congestion window in effect for a packet arriving at 
the queue at time t. This was the sender's congestion 
window at an earlier time, when the packet left the 
sender. 

In developing the models we will often refer to the 
round-trip time, R. The round-trip time is the time 
between the departure of a packet from the sender and 
the return to the sender of the acknowledgment for that 
packet. It consists of a fixed propagation delay, a, and 
a queuing delay. For a packet encountering a single 
congested router with queue length q, and outgoing 
link capacity c (measured in packets per unit time), the 
queuing delay is q/c. Thus, 

= a + 1 (1) 

c 

A. THE CONTINUOUS-TIME MODEL 

Our continuous-time model consists of two distinct 
parts. The first part is a system of differential equations 
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similar to the one found in [4]. It is used to model the 
additive-increase of the window size, and both instanta- 
neous and averaged queue lengths. The second part of 
the model is an impulse in which the window size state 
variables are instantaneously reset. This is used to model 
the multiplicative decrease in the window size caused by 
a dropped packet. 

1) MODELING THE ADDITIVE INCREASE: Ac- 
cording to TCP, the window size, W, will normally 
increase by 1/W upon receipt of each acknowledgment. 
(We do not model the "slow start" phase in which the 
window size increases by one per received acknowledg- 
ment.) Since W specifies the number of unacknowledged 
packets that can be out in the network at any one time, 
it follows that about W packets are sent per round-trip 
time, R. Thus, in approximately one round-trip time, 
W acknowledgments return (assuming no lost packets), 
causing W to increase by 1. Although network data 
is transmitted in discrete packets, during the period of 
additive-increase and in the absence of dropped packets, 
quantities appear to vary smoothly when viewed over the 
time-scales we are interested in (on the order of 1 to 100 
seconds) for our network settings. Hence we model the 
additive-increase of the window size continuously: 

dW{t) 1 
dt R(q(t))' 
The rate of change of the queue length at a given time 
is equal to the difference between the flows into and out 
of the router. By the explanation above, the flow into 
the router at time t is W (t) j R(q(t)) . If the queue is 
occupied, the flow rate out will be equal to the capacity 
of the router's outgoing link, c. Otherwise the flow out is 
equal to the minimum of c and the incoming flow rate. 
w(t) „ 



dq{t) 
dt 



max 



( W(t) 

\R(q(t)) 



when q(t) > 0, 
c, o) when q(t) = 0. 



(3) 

The exponentially-weighted average queue is deter- 
mined by RED upon each packet arrival as follows: 



x n +i = wq n+ i + (1 - w)x n , 



(4) 



where w is the exponential-weighting parameter, < 
w < 1, and the subscripts denote successive measure- 
ments of q and x (which occur at packet arrivals) for 
a given router. This equation describes a low-pass filter, 
and, making use of the fact that w is small in practice, 
it can be approximated by the differential equation: 

dx(t)/dt = w(q{t) - x(t)){W(t)/R{q(t))). (5) 

The term W{t)/R{q{t)) expresses the rate of packets 
arriving at the queue. The model is summarized by 
equations ©, ©, and ©. 



Because of our bulk-transfer and bottleneck assump- 
tions (see Sec. UJi, the network is often congested to 
the point of saturation. This allows us to simplify the 
model by discarding the q = case in equation ©, and 
replacing the packet rate term in equation (J5J) with the 
bottleneck link capacity, c, as follows: 



1 



dW(t) 

dt ~ R(q(t)) 

dq(t) W(t) 



dt 
dx{t) 



R(q(t)) 
wc{q{t) — x(t)). 



(6) 



(V) 



(8) 



dt 

2) MODELING THE MULTIPLICATIVE 
DECREASE: In a real network situation, a router 
using RED will drop an arriving packet with probability 
p given by: 







p(x) 



x—q n 



when x < q min , 

~Pmax when q m in ^ X qmax j 

when x > q max . 



(9) 

In practice, this usually causes a packet to be dropped 
soon after x exceeds q m in- F° r the purposes of keeping 
our model simple and deterministic, we assume a drop 
occurs as soon as x exceeds q m in- We continue to evolve 
the continuous system for one round-trip time to reflect 
the delay in notification of the sender that a packet has 
been dropped. Then we cut the window state variable, 
W, in half. Next the continuous evolution resumes but 
we hold the window state variable constant for one 
round-trip time 1 . This is done in order to represent the 
Fast Recovery/Fast Retransmit(FRFR) algorithm in the 
NewReno 2 version of TCR Once this round-trip time 
has elapsed, the model resumes continuous evolution as 
described in Section III-A.ll 

Denoting the continuous-time system of equations 
©, Q, and © by A, we can summarize the continuous- 
time model in hybrid systems form as in Fig. |2j where T 
is a timer variable. The use of a hybrid system to express 
the model was suggested by [10]. Our model begins 
in the congestion avoidance phase, following the set of 
equations, A. Once x exceeds q m in, the model assumes 
a drop occurs, and it transitions to the delayed drop 
notification phase. In this phase, it continues following 
the original set of equations but now it also utilizes a 
count-down timer, T, which expires one round-trip time 

'For simplicity, we are neglecting the period in which no data are 
transmitted which would necessarily occur after the window cut. 

2 Recent indications are that NewReno appears to be the most 
widely used variant of TCP [1]. 
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Fig. 2. Hybrid systems view of the continuous-time model. A stands 
for equations 0, and {S). T' = dT/dt and W = dW/dt. 



from the time x exceeds q m in- Once this timer expires, 
the model transitions into the recovery phase, first cutting 
W in half and initializing a new count-down timer at 
the value of the present round-trip time. In the recovery 
phase, the equations still hold, but with one exception: W 
is now held fixed. Finally, when this count-down timer 
expires, the model returns to the congestion avoidance 
phase. 

3) MODELING MULTIPLE SENDERS: The 
continuous-time model can be easily generalized to 
handle more than one sender. As in the case of one 
sender, we assume each additional sender is upstream 
from the bottleneck link and engaged in bulk transfer, 
sending data as fast as allowed by TCP. Following [4], 
denote the window size of the i th sender by W{. We 
keep track of each sender's window separately. The 
queue equation © is replaced by: 



dq(t) 
dt 



N Wj(t) 



<=i ft («(*))■ 



when q(t) > 0. 

c, 0) when q(t) = 0. 

(10) 

The connections need not all share the same fixed 
propagation delay, as the B4 terms indicate. We use a 
separate copy of © for each window W%, and a separate 
timer variable for each connection. 

B. TOWARDS A DISCRETE-TIME MODEL 

In practice, the differential equations in the 
continuous-time model can be solved by numerical 
integration using a simple scheme such as Euler's 
method. The main requirement is that the time step be 
small enough to reflect system behavior occurring on 
the smallest time-scale. In the given network scenario, 
the smallest time scale is the spacing between packets, 
which, as dictated by the bottleneck link, is equal to 



1/c. We will now show that the use of 1/c as a time 
step allows us to express the model in a simplified way 
as a discrete-time system. 

The Euler numerical integration step for the W equa- 
tion ©, is 

W k+1 = W k + h 1 , (11) 

a + q k /c 

where h represents the time step. Setting h = 1/c, we 

1 



have 



W k+1 = W k + 



(12) 



ac + q k 

For the q equation @, neglecting the q(t) = term for 
the moment, the Euler step is 

W k 



Qk+l = q k + h 



which simplifies to 



Qk+l = qk + 



a + qk/c 



w k 



1. 



(13) 



(14) 



ac + q k 

using the time step 1/c. Note that in the above equation, 
the middle term represents the flow in per time step and 
the final term, the —1, represents the flow out per time 
step. In case the queue is empty, we omit the —1 term 
as no packets will leave within that time step: 

f <lk + ^ 

Qk+l - 



™ , ac+qk 1 when % >0, 
.^ + ^ = ^ when, fc = 0. (15) 

Finally, it is easy to show that this choice of time step 
returns the equation for x back to its original form. 



x k+1 = wq k+ i + (1 - w)x k . 



(16) 



Note, we are still using the assumption that RED is 
updating the average queue size as if packets were 
arriving at the queue at a rate of c. 

Summarizing these equations, we have a discrete- 
time model representation of the original continuous- 
time system that gives an intuitive description of the 
TCP dynamics on the shortest time-scale. We can utilize 
the same overall procedure as the continuous-time model 
(see Fig. |2j, substituting the maps (112b . dT5l) and (fT6l 
above for the differential equations Q and ©. 

C. THE DISCRETE-TIME MODEL 

We can derive a similar but even more simplified 
discrete-time model by making the assumption that the 
system is saturated. As with the continuous-time model, 
the discrete-time model uses the three state variables W, 
q, and x and consists of two primary components. The 
first component is a discrete-time map used to model the 
change in each of the state variables during the additive 
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increase phase. The second part is an impulse that works 
similar to the one in the continuous-time model - it 
accounts for the sudden adjustment in the window size 
due to a dropped packet. 

1) MODELING THE ADDITIVE INCREASE: In 
practice, after an initial transient, the bottleneck link 
in the scenario we model will reach saturation and a 
queue will form at the router. Packets leave the queue 
at evenly spaced intervals of length 5 = 1/c, where c 
is the capacity of the outgoing link. For instance, if the 
link has a capacity of 200 packets per second, the out- 
going packets will be spaced (front-to-front) by l/200s 
or .005s. 3 When these packets reach their destination, 
acknowledgment packets are sent out, with the same 
spacing. The arrival of the acknowledgment packets at 
the sender results in the sending of new data packets. 
Receipt of an acknowledgment frees one packet position 
in the TCP send window, W, and causes W to increase 
by 1/W. Typically this means that one packet is sent for 
each arriving acknowledgment. Occasionally, when W 
reaches the next integer value, two packets are sent upon 
receipt of an acknowledgment. In other words, usually 
one packet arrives at the queue every 5 seconds while 
one packet leaves the queue every 5 seconds, resulting 
in no net change in queue length. But occasionally, 2 
packets arrive at the queue in a <5-second interval while 
still only one leaves. This is the primary cause of queue 
length increase in this scenario. 

The description above refers to what is sometimes 
known as the self-clocking nature of TCP. That is, a TCP 
sender has the ability to determine the limiting capacity 
in its flow path and send its packets at that rate. We take 
advantage of this behavior in our model, by employing 5 
as the time step in a discrete-time model of this system. 

The time step is given by: 

t k = t + kd, k = 0,1,2,... (17) 

where the time to marks the start of saturation. Our 
equation for W follows directly from the rules of TCP: 

W k+l = W k + -L. (18) 
We express the change in the queue length as follows: 

Qk+l = <?fc + (19) 

While this yields fractional-valued queues, it does 
result in the queue length increasing by 1 each time W 
increases by 1, as described above, and is simpler to 

throughout this paper we assume uniform packet size unless 
specified otherwise. 



express than the more realistic alternative. The equation 
for x is the actual equation used by RED (the assumption 
of saturation means packets arrive each time step and so 
x is updated each time step): 

Xk+i = wq k + (1 - w)x k . (20) 
The round-trip time, from Q, is: 

R(q h ) = a+^= + (2D 

In multiples of the time step 5, the round-trip time is 
thus best approximated by m k = nint(a/5 + qu) where 
"nint" means the nearest integer. 

We initialize the additive-increase phase of the model 
at the start of saturation, or, in other words, at the onset of 
queuing. Just prior to this time, there is an exact balance 
between the flow in and out of the router. The flow in 
is equal to W (t ) / R(q(t )) = W(t )/(a + q(t )/c). 
Since q(to) = at this point, the flow in is W{to)/a 
and the flow out is c. Thus the initial conditions for the 
discrete-time model are go = and Wo = ca. (Note 
that Wo corresponds to the so-called bandwidth-delay 
product which is often used to estimate buffering for 
network resources.) 

2) MODELING THE MULTIPLICATIVE 
DECREASE: We model the multiplicative decrease 
here in much the same way as in the continuous-time 
model but with one additional element. As in the 
continuous-time model, we assume a drop occurs as 
soon as x exceeds q m in'- If %k > q m in then at time 
k + mk — 1, replace (fT8t with 

Wk +mk = ^W k +m k -l, (22) 

which reflects the delay of 1 round-trip time in drop no- 
tification. We take advantage of the packet-level timing 
of this model to incorporate an additional aspect of what 
occurs to a network sender following a window cut. In 
a network, after cutting its window from W to W/2, 
the sender will not send packets for W/2 time steps. 
This reflects the fact that acknowledgments for packets 
in the half of the window that is no longer accessible 
will not trigger the transmission of any new packets. 
As a result, the queue length will decrease. We model 
this by using the following equations for the next W/2 
timesteps where W is the window size just prior to the 
window cut: 

W k+1 = W k , (23) 
Qk+i = Qk ~ 1- (24) 

Note that Wk remains fixed following the rules of 
Fast Recovery/Fast Retransmit, as was done in the 
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Fig. 3. Hybrid systems view of the discrete-time model. 



continuous-time model. Next we continue to hold Wk 
constant and now also hold g% constant to reflect the 
rest of the recovery period. In other words, the sender 
is sending packets but not increasing its window, hence 
the queue length should remain fixed: 



Qk+i — Qk- 



(25) 



As with the continuous-time model, we can present the 
discrete-time model in hybrid systems form as pictured 
in Fig. |3] Each rounded rectangle contains the numbers 
of the equations to be used, and a timer variable, is 
utilized. The model begins in the congestion avoidance 
phase, obeying equations d 1 8I > , ( 119b . and (120b . Once x 
exceeds q m in, the model assumes a drop occurs, and it 
transitions to the delayed drop notification phase. In this 
phase, it continues to obey the original set of equations, 
but now it also utilizes the count-down timer, Tk, which 
expires one round-trip time from the time x exceeds 
Qmin- (The round-trip time is given by m&, which was 
defined following equation STf\ .) Once this timer expires, 
the model cuts Wk in half, initializes a new count-down 
timer at the value of the present round-trip time (which 
we label m) and transitions into the recovery phase 
in which no packets are being sent. In this phase of 
the recovery, replace equations ( fT8t and (IT9l used in 
the earlier phases, with (123b and (124b . respectively. As 
mentioned above, this phase should last W/2 time steps. 
It is not difficult to show that this W/2 is equal to .5m 
though we leave this result out for the sake of brevity. 
When the timer has been reduced by .5m, the model 
moves into the final state - recovery with transmission. 
Here it uses equations d23b . (125b and d20T> . Finally, when 
the count-down timer expires, the model returns to the 
congestion avoidance phase. 

3) MODELING MULTIPLE SENDERS: In order to 
account for multiple senders, we must modify the 



TABLE I 
Parameter Settings 



Variable 


Description 


Value 


a 


Fixed propagation delay 


.01 s 


c 


Bottleneck link capacity 


1.5 Mbps 




RED parameter 


50 


Qmax 


RED parameter 


100 


Pmax 


RED parameter 


.1 


W 


RED parameter 


.003 




Packet size 


1000 bytes 



discrete-time model. Consider the case of two senders, 
with window sizes of WW and W^. Typically the 
senders will alternate sending windows of packets. As 
a result, acknowledgments will arrive at a given sender 
in bunches. Thus, the 1/Wj. increase per time step 5 
indicated in (118b . will not actually occur each time step 
for each sender. However, each connection's window will 
still increase by 1 per round-trip time. One way to reflect 
this in the model is to choose a time step of 26, use the 
original W equation d"T8b for both senders, and change 
the queue equation to 



Qk + 



+ 



1 



(26) 



For n senders, use a time step of nd and include the 
term l/wjf in the queue equation for each sender j = 
1,2, ...,ra. 



D. RESULTS 

In this section we compare results obtained from 
applying our models to the network set-up mentioned 
above with those obtained using the ns simulator on an 
equivalent network. We used the settings listed in Table|l] 

We implemented the models in MATLAB. Since we 
do not model the slow-start behavior of TCP, we begin 
the comparison after an initial transient has ended. In 
Fig. EJ the top plot shows a comparison of the queue 
length in the continuous-time model with the results 
from the ns network simulator. The middle plot shows 
the results of the discrete-time model compared to the 
simulator. The bottom plot compares results from the 
fluid model of Misra et al. [4] with the simulator [13]. 

Despite their lack of a stochastic component as well 
as several of the details of the TCP implementation, 
our models show good qualitative agreement with the 
simulator. We believe that the models have captured 
the essential behavior of this network under these flow 
conditions. The use of an impulse helps the models 
account for the sharp declines in the queue length caused 
by drop events. Lacking this feature, the fluid model of 
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Fig. 4. Comparison for one sender 
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Fig. 5. Comparison for two senders 



Misra et al. does not perform as well in this case of one 
sender. 

One of the continuous-time model's inaccuracies is 
that the queue length drops down too far. Lacking the 
no-send phase of the recovery that was included in the 
discrete-time model, the continuous-time model's queue 
does not drop as much during the recovery period. This 
in turn causes x to stay artificially high, high enough 
so that after the recovery is complete, it is still above 
Qmin- As a result, a subsequent drop occurs, followed 
by an additional window cut and recovery period, all 
resulting in a further drop in the queue length. The 
consecutive recoveries' negative contribution to queue 
length outweigh the positive contribution on the queue 
length of the lack of a no-send phase. The discrete-time 
model does not have this problem due to the use of the 
no-send recovery phase. 

Another discrepancy found between our models and 
the simulator is in the period length of the queue 
oscillations. The discrete-time model's period is too short 
because of the assumption of an instantaneous drop. At 
these settings, it takes, on average, around one second 
from the time RED turns on until a packet is dropped. 
In Sec. |ffl] we introduce a method to estimate this delay 
and incorporate it in the models. The continuous model's 
period is too long because of the dual recovery periods 
which outweigh the effect just mentioned. 

Fig. [5] shows a similar comparison except now we 
consider two senders on the network with identical fixed 



delays. The network has become harder to model as 
evidenced by the increased randomness in queue vari- 
ations. Around the region 60 < t < 80, the simulator's 
behavior is analogous to its typical behavior in the 
one-sender case. Hence, the statements made in the 
previous paragraph apply there. What is occurring in 
that region is one drop for each sender for each drop 
event. For much of the rest of the time interval shown, 
the variation is due to different drop occurrences such as 
two drops for one sender, only one drop, three drops and 
others. This suggests a modeling approach more directed 
towards statistical agreement than short-term qualitative 
agreement for cases of anything but a small number of 
senders. 

For larger numbers of senders the model of Misra et 
al. shows better agreement with the simulator than our 
models do. Thus our models are advantageous mainly 
in cases when the bottleneck link congestion is due to 
a small number of senders. We propose extensions to 
our models in the following section to improve their 
performance. 

III. EXTENSIONS 

Model simplicity is important if we are interested 
in being able to concisely describe a system, and for 
amenability to mathematical analysis. On the other 
hand, for the purpose of traffic state estimation, the 
key attributes we desire in a model are accuracy and 
computational efficiency. With this in mind, we introduce 
extensions to the models to improve their accuracy while 
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still keeping the models simpler than a full-fledged 
packet-level simulator. The primary modification we 
consider is to implement a more realistic packet dropping 
mechanism within the models, one that more closely 
resembles RED. 



Instantaneous queue length 



2 70 
I so 

1 50 
*40 
30 
20 
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continuous-time model 




A. ESTIMATING THE INTERDROP TIME 

As was mentioned in the previous section, one of the 
discrepancies between the models and simulator is that 
the models assume a drop occurs as soon as RED turns 
on. In reality, there tends to be a delay of about one 
second under the settings we are using. Here we describe 
a method to estimate this delay that we can incorporate 
into the models while still keeping them deterministic. 

In practice, RED has an added layer of complexity. 
Namely, it has been designed so that effectively, the 
drop time is chosen from a uniform distribution on a 
time interval of length l/p, given a constant RED drop 
probability p. As implemented in the ns simulator [13], 
an additional wait parameter is used, which causes this 
time interval to lie between l/p and 2/p from the time 
of the last drop. (This spacing also applies to the time 
between RED turning on and the first drop.) As a result, 
the expected time between drops is 3/(2p). 

More precisely, when x exceeds q m in and RED turns 
on, it begins counting packets in order to determine when 
a packet drop should occur. The actual drop probability 
used by RED, which we denote Pdrop, lS given by: 

when k < l/p, 
Pdrop(p, k) = { p/(2 - kp) when l/p < k < 2/p, 

1 when k > 2/p, 

(27) 

where k is the number of packets that have arrived 
since RED turned on, or since the previous packet drop. 
Let K be the random variable representing the number 
of packets that arrive between drops, or between RED 
turning on and the first drop. If x is constant, then p 
is constant, in which case it can be shown that K is 
uniformly distributed between l/p and 2/p. This means 
E[K] = 3/2p. 

Of course x is generally not constant, and in our model 
we make the rough approximation that E[K] is the 
solution to the equation kdrop = 3/{2p(xk dro )], where 
Xk is the value of x when the packet counter reaches 
k. We further approximate x as a linear function of k 
between packet drops. Rewriting © as 



x k = x k -\ + w(q k - Xk-i), 
we replace q k - x k -i by q - x : 

x k = x + kw(q - Xq) 




Fig. 6. Comparison of models with ns simulator for the one-sender 
scenario described in Sec. III-Dl 



Assuming that Xk remains between q m in and q ri 
p(k) = a\k + a 2 



(30) 



where a\ and a 2 are constants determined by equa- 
tions © and ( E9l . 

Since we want to find kdrop such that kdrop = 
3/[2p(xk dro )], we substitute d3*0T ) into this equation. 
Solving the resulting quadratic produces the following 
solution: 



k, 



drop 



2^i 



(31) 



If a| + 601 < 0, then since a\ < 0, p(k) is a decreasing 
function of k, and we assume that it becomes zero before 
another drop occurs. 

We change the model as follows. When RED turns 
on, we compute k, the expected time until the next 
packet drop. A timer variable counts down this amount 
and when it expires, we consider the drop to have oc- 
curred and follow the same procedure as in the previous 
models. This scheme can be implemented for both the 
continuous-time and discrete-time models. In Fig. we 
present results of its application to the continuous-time 
model. The figure shows that using this extension, the 
model is able to very closely reproduce the behavior of 
the simulator. However, the accuracy of this approach 
diminishes as the number of senders increases. For 
even greater accuracy, we fully implement RED as it 
is executed in the ns simulator. This is described in the 
following section. 



(28) B. FULL RED IMPLEMENTATION 



(29) 



In order to fully model RED, we begin by following 
the procedure laid out in the previous section up to 
equation d27b . At that point, a uniform random number 
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Continuous-time model with ful RlD implementation 




Fig. 7. Comparison for four senders between the ns simulator 
and a realization of the continuous-time model using the full RED 
implementation. In both plots, the upper two curves represent the 
instantaneous and exponentially averaged queues. (The exponentially 
averaged queue is the curve showing less variation.) The lower four 
curves in both plots represent the window sizes of the four senders. 



between and 1 is generated and if this number is less 
than Pdrop, a drop occurs. In the case of multiple senders, 
the probability of a given sender experiencing the drop is 
proportional to that sender's share (^)/(X)fLi °f 
the overall flow. This introduces a greater degree of com- 
plexity and a stochastic component to the model. Since 
our ultimate goal is network traffic state estimation, our 
main priorities are model accuracy and computational 
efficiency. 

We applied this model to the network described earlier, 
but now with four senders at varying fixed propagation 
delays from the receiver. Fig. shows that there is 
good qualitative agreement between the model and the 
simulator. The additional jitter in the simulator's queue 
is due to packet level activity. The model shows good 
statistical agreement with the simulator as well. Fig. [8] 
shows a comparison of queue histograms. Note that 
the model correctly captures the range in queue values, 
which can be used to calculate the range of round-trip 
times. 

In order to evaluate the model's responsiveness to 
network changes, we tested it on a network with two 
classes of flows, one of which turns off for part of the 
run. The classes both consist of five bulk transfer senders, 
but the fixed propagation delay is different for each class: 
20 ms for class 1 senders, 35 ms for class 2 senders. The 
class 2 senders turn off from 75 to 125 seconds after the 
start of the run. In practice, this effect could be caused 




30 35 40 45 50 55 60 65 70 75 
Instantaneous queue value 



Continuous-time model with full RED implementation 



Instantaneous queue value 



Fig. 8. Comparison of instantaneous queue histograms for the four- 
sender network. The model is using the full RED implementation. 
Model queue values, which may be fractional, have been rounded 
for the purposes of comparison. 



by the sender-side application not having data to send for 
that stretch of time. Another possibility could be that the 
class 2 senders are temporarily rerouted. 

The results, shown in Fig. |9l indicate that the model 
does a good job of capturing the changes in the network 
state caused by the senders turning off. This includes 
the sudden drop in the queue just after the senders turn 
off. The model also reproduces the overall decreased 
level of the queue and increased level of the class 1 
senders' windows during the class 2 off period. Since 
both simulator and model have stochastic components, 
each plot represents a realization rather than the expected 
performance. Nevertheless, based on our observations 
of many realizations for both model and simulator, we 
expect the average performance to show good correspon- 
dence as well. For the time being, we give statistics 
from sample realizations in Table |HJ indicating the close 
statistical match between model and simulator. Note that 
the model is able to estimate the variance of the queue 
to within 10%. This implies that by using the model 
in conjunction with the round-trip time equation (Q, a 
reasonable estimate of the variance of the round-trip time 
can be obtained. 

IV. TOWARDS NETWORK STATE ESTIMATION 

Ultimately, we plan to use these models in a network 
traffic state estimation scheme. The state estimation 
problem can be posed as follows: Consider a network of 
iV senders and one bottleneck router, whose state can be 
characterized by the sender window sizes and the router 
queue and exponentially averaged queue lengths. Given 
only a series of observations of some subset of the full 
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Fig. 9. Comparison for two classes with five senders per class. Class 
2 senders are off from 75 to 125 seconds. 



being Gaussian. Thus it is a better fit for our model and 
system. 

The particle filter starts off with a random ensemble 
of states. It uses the observation to filter and re-weight 
the ensemble members based on how consistent they are 
with the observation. Then the ensemble members are 
advanced in time using the model, and the filter and re- 
weighting process repeats. We are currently testing this 
procedure in a variety of network scenarios. 

V. CONCLUSION 

We have developed two deterministic models with a 
discrete impulse that successfully capture the network 
behavior of TCP/RED in simple cases. Extending the 
models by adding a stochastic dropping mechanism 
consistent with RED, the models shows good correspon- 
dence in more complicated network situations, including 
those with larger numbers of senders and flows turning 
on and off. 

Aside from network traffic state estimation described 
in Sec . 11 VI other works in progress include estimation of 
some dynamical properties such as period length, max- 
imum sender window size and drop rate. Additionally, 
we are applying our models to networks subject to cross- 
traffic, including one that is prone to irregular behavior 
due to the presence of a source that sends large bursts 
of packets at regular intervals. 4 



TABLE II 

Statistical Comparison 



Variable 


Quantity 


Simulator 


Model 


All Flows On 


q 


mean 


65.5 


66.7 


q 


st.dev. 


4.8 


4.4 


Half of the Flows Off 


q 


mean 


56.0 


56.0 


q 


st.dev. 


7.0 


6.5 



network state, such as the window sizes and round-trip 
times of a small number of senders, what is our best 
estimate of the state of the system at the current time? 
That is, we must estimate all of the sender window sizes, 
using only the past history of some observed portion of 
the state of the network. 

The estimation scheme we have in mind can be 
described as a particle filter or, more generally, a sequen- 
tial Monte Carlo method [14], [15]. The basic idea is 
related to that of a Kalman filter. But unlike the Kalman 
filter, the particle filter makes no assumptions about the 
linearity of the model, or about probability distributions 
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